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Abstract. We study the temporal evolution of the market efficiency in the stock markets using the com- 
plexity, entropy density, standard deviation, autocorrelation function, and probability distribution of the 
log return for Standard and Poor's 500 (S&P 500), Nikkei stock average index, and Korean composition 
stock price index (KOSPI). Based on a microscopic spin model, we also find that these statistical quantities 
in stock markets depend on the market efficiency. 

PACS. 89.65.Gh Economics; econophysics, financial markets, business and management - 89.70.+C Infor- 
mation theory and communication theory - 89.75.Fb Structures and organization in complex systems 

1 Introduction ferent characteristics between mature markets and emerg- 

ing markets [11], market efficiency |12j . and the relation 
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Econophysics is one of the most active fields in interdis- between shape of PDFs and time l ags fT3] are studied us 
, ciplinary research 1 2345 678 9 10111112113] . Time se- 
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ing PDFs. Also it is used to distinguish between bubble 



ries analysis and agent based modelling have been stud- an( j an ti_b u bbl e [9 l 10] 
ied by many researchers. There are many methodologies 
to analyze the financial time series. Observing probabil- 

ity distribution functions (FDFs) of log return is one of Another method is computational mechanics [16 . Com- 

the simplest and the most popular methods. Many re- Phonal mechanics has been studied various fields of 

search papers about PDFs of log return for stock markets science I 17 ' 18 ' 19 ! ' and [t is a PP lied to anal y ze the stock 

have already been published [10 1 11 1 12 1 13 1 14 1 1 5] . The dif- market H- Computational mechanics is available to an- 

alyze complexity and structure quantitatively by finding 

Send offprint requests to: In-mook Kim 

a e-mail: imkim@korea.ac.kr intrinsic causal structures of time series |2"0"1. 



Jae-Suk Yang et al.: The market efficiency in the stock markets 



Agent based modelling has been widely used in so- 
cial science and econophysics to construct artificial so- 
cial and economic systems. Agent based models in econo- 
physics are constructed using agents clustering p.J, Ising- 
like spin model [2112] . and Potts- like model [4]. Variation 
of PDFs shapes by traders' characteristics [TU] and infor- 
mation flow [12j . and speculative activity explaining bub- 
bles and crashes in stock market [5] have been simulated 
by agent based model. 

In this paper, we analyze the time series of Standard 
and Poor's (S&P 500), Nikkei stock average index, and 
Korean composition stock price index (KOSPI) by time 
evolution of statistical measures such as PDFs of log re- 
turn, autocorrelation function, complexity, entropy den- 
sity, and scaling properties of the standard deviation of 
log return. Moreover, we construct the stock market us- 
ing microscopic spin model to simulate above time series 
results. 



is defined as 



2 Empirical data and analysis 

We use the S&P 500 data mainly for the period from 1983 
to 2006. Japanese data for the period from 1997 to 2005 
and Korean data for the period from 1992 to 2003 are 
also used to support and confirm the results from S&P 
500. The data resolution is high frequency (1 minute) data, 
and we use only intra-day returns to exclude discontinuity 
jumps between the previous day's close and the next day's 
open price due to the overnight effects. The price return 



S(t) = log y(i + At) - log y(t), 



(1) 



where Y(t) is the price at time t and At is the time lag. 

2.1 Probability distribution and autocorrelation 

The distribution of price changes are identified as non- 
Gaussian [12113114115121] . Especially, when the PDF has 
the power law tail, the exponent of power at tail part can 
be gotten from the PDF. That exponent is called as tail 
index. 
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Fig. 1. (a) Temporal evolution of tail index and (b) variance 
of autocorrelation function for the S&P 500, the Nikkei stock 
index, and the KOSPI. 
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Fig. [Ik shows temporal evolution of tail index in PDFs 
for S&P 500, Nikkei stock index, and KOSPI. Tail index of 
PDFs increases from around 2 to above 4 as time passes. 
In 2000s, the shape of PDF becomes narrower and the tail 
part becomes thinner, while PDF has fatter tail and the 
slope of tail part is more steep in 1990s. Autocorrelation 
function is defined as follows: 

< S(t)S(t + T) > 
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Fig. 2. Temporal evolution of scaling properties of the stan- 
where a is a standard deviation of S(t). Moreover, the dard deviation of log return. 



variance of autocorrelation function is defined as follows: 
V ACF =< R(t) 2 > . (3) 

Fig. [Ib shows the temporal evolution of variance of au- 
tocorrelation function. The increasing tendency for tail 
index is reverse to it for variance of autocorrelation func- 
tion. We can guess that the reason why probability distri- 
butions of log return are changed is related to autocorre- 
lation of log return time series. 

Though the tendency is same for three stock markets, 
the value of tail index for the S&P 500 is larger than it 
for the KOSPI and Vacf for S&P 500 is smaller than it 
for the KOSPI in the 1990s. 

2.2 Scaling property of standard deviation 

We investigate the long range memory of log return by 
observing the time evolution of scaling properties in the 
standard deviation of log return [5] . The standard devia- 
tion of log return is defined as 



as a function of the time lag At. The relation between 
standard deviation and time lag is as follows: 



a(At) ~ At". 



(5) 



'j^ =1 ^ogY(U + At)-\ogY(U)) 2 

= ~ (4) 

y/n — 1 



When /i is larger than 0.5, the time series has long range 
correlation, while long range anticorrelation when // < 0.5. 
There is no correlation at /i = 0.5 and strength of correla- 
tion (or anticorrelation) is proportional to the difference 
between \i and 0.5. Fig. [2] shows the temporal evolution 
of scaling properties of the standard deviation of log re- 
turn. The value of [i decreases to around 0.5. Until the mid 
1990s, time series of stock market index has strong long 
range correlation. However, long range correlation practi- 
cally disappears in 2000s. 

In spite of the same tendency for temporal evolution 
of fi, the S&P 500 is more close to 0.5 than the KOSPI in 
the 1990s. 
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2.3 Entropy density and statistical complexity as a function of block length L where L = 1, 2, 3, • • •. En- 

tropy density is more useful because it is normalized quan- 
We also analyze financial time series using computational tity whilc H ^ also increases as L i ncre ases. 
mechanics to find the statistical complexity and the en- In next; to ca i cmate statistical complexity e-machine 
tropy density. In order to calculate statistical complexity, hag to be defined An infinity gtring can be divided into 
we used causal-state splitting reconstruction (CSSR) al- twQ semi _ infinite parts such as a future 1? and a history 
gorithm [Mj to model e-machine of the stock markets. A causal gtate ig defined ag a get of histories that have 

To calculate the entropy density and the statistical the same conditional distribution for all the futures, e is 
complexity, we should symbolize the time series as follows: a function that maps each history to the sets of histories, 

each of which corresponds to a causal state: 



F(t) = 9(Y(t + At)-Y(t)), (6) 



e(s ) = {s' | P(S L = s L | S =s) = P{S L =s L \S = s' ), 

s 1 eS I ) l'eS,LeZ + }. (10) 



where 9(x) is a Heaviside step function. Then the original 
data Y(t) are changed into the binary time series F(t) 
with a countable set A = {0, 1}. F(t) is (or 1) when the The transition probability T- °"' denotes the probability 
next index has decreased (or increased) . of generating a symbol a when making the transition from 

Claude Shannon suggested the entropy of a discrete state Si to state Sj [23124) . 
random variable X with a probability function P(x) [22] The combination of the function e from histories to 
as follows: causal states with the labelled transition probabilities 

is called the e-machine |23j . which represents a computa- 
tional model underlying the given time series. 



H[X] = -J2P(x)log 2 P(x). (7) 



Let A be a countable set of symbols of time series and let Given the machine, statistical complexity is defined 

S be a random variable for A, and s is its realization. If as 

a block of string with L consecutive variable is denoted C^ — — ^ P (Si) log 2 P( Si). (11) 
as S L = Si, S L , then Shannon entropy of length L is Fig. [3] shows temporal evolution of statistical complex- 
defined as ity and entropy density. Statistical complexity decreases 



H[X] = -J2'--J2 p (*i' -' Si ) lo S2 P(*u ■», «£)• 



and entropy density increases in all three markets as time 



sieA s L eA passes. 

(8) 



Also entropy density for the finite length L is define as 



Statistical complexity is around when time series has 
regular pattern or it is totally random. To clarify whether 
h^(L) = H(L) — H(L — 1), (9) the time series is random or regular, the entropy density is 
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Fig. 3. Temporal evolution of (a) statistical complexity and 
(b) entropy density. 

needed. Time series is totally random when entropy den- 
sity is around 1 and entropy density is when time series 
has periodic pattern because it is a measure of disorder. 
So we can find out that the time series of stock markets is 
getting more randomly and the patterns in the time series 
almost disappear in 2000s. Also the values of complexity 
and entropy density for the S&P 500 are different from 
them for the KOSPI, though the inclination is same. 

3 Model and results 

We constructed the microscopic model of many interact- 
ing agents to simulate the variation of some statistical 



characteristics for the stock price time series by modify- 
ing microscopic spin model [2] . The number of agents is N, 
and we consider i — 1,2, ... ,N agents with orientations 
Ui{t) = ±1, corresponding to the decision to buy (+1) and 
sell (—1) stock at discrete time-steps t. The orientation of 
agent i at the next step, rjj(t + 1), depends on the local 
field: 

/H*) = ^£^(*)^(*) + M*), (12) 
j 

where (t) represent the time-dependent interaction streng 
among agents, and hi(t) is an external field reflecting the 
effect of the environment. The time-dependent interaction 
strength among agents is Aij(t) = A£(t) + arjij(t) with 
£(t) and rjij(t) determined randomly in every step. A is 
an average interaction strength and a is a deviation of the 
individual interaction strength. The external field reflect- 
ing the effect of the environment is hi — hQ(t), where h 
is an information diffusion factor, and Q(t) is an event 
happening at time t and influencing the i-th agent. 

From the local field determined as above, agent antic- 
ipates log return of stock index as follows: 

2 



i. 



(13) 



i +e - 2/ rw 

So, the local field on agent can be represented as follows 



i i (t)=ir(t)+a(x(t-i)- x r p (t-i)) 



(14) 



where a is degree of adjustment. When a = 0, agents de- 
termine their opinion from if", while agents determine 
their opinion from the price or log return of previous step 
as well as information flowed into the market when a is 
non-zero. For instance, in case positive a and x(t — 1) > 
x^ xp (t — 1), agents determine their opinion by adding the 
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difference between the market price changes and the antic- 
ipated price changes at the previous step. On the contrary, 
in case x(t — 1) < x^ xp (t — 1), agents subtract the differ- 
ence from If to adjust their inexact information. By this 
way agents refer to past performance, while agents act by 
fundamental expressed by If" in case of a = 0. 

From the local field determined as above, agent opin- 
ions in the next step are determined by: 



«Ti(t+l) = 



(15) 



-1 with probability p 
- 1 with probability X — p 

where p = 1/(1 + exp{— 2/j(f)}). In this model, price 
changes are: 

*(*) = ^ !>(*)• ( 16 ) 
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Fig. [4^ shows variance of autocorrelation function for 
various a. As a decreases, the tail is getting thinner and 
thinner, and the strength of autocorrelation is reduced. 
Moreover, scaling exponents of standard deviation go to 
0.5 as a decreases [see Fig.|4p]. The generated time series 
has long range correlation for larger a, and Correlation is 
almost disappeared for small value of a. 

In Fig. [SJ we can confirm the tendency of statistical 
complexity and entropy density for various a. As a de- 
creases, statistical complexity decreases and entropy den- 
sity increases. From the statistical complexity, the pattern 
in time series is getting simpler or the degree of random- 
ness of times series is larger for smaller a. What entropy 
density is 1 means the time series is practically random. 
Fig. is the relation between entropy density and statis- 
tical complexity. From this relation we can distinguish if 
the time series is random or regular. 



4 Conclusions 



0.000- 



We analyze the time series of stock index of U. S., Japan, 
and Korea using some statistical measures and simulate 
them by microscopic agent based spin model. 

Time series has a fat tail in log return distribution and 
a tail index is increased as time passes to present. Exis- 
tence of pattern in the financial time series can be con- 
a firmed by autocorrelation function, entropy density and 

complexity. As time goes from past to present, entropy 
Fig. 4. (a) Variance of autocorrelation function for various density is increased and complexity is decreased. Also au- 
and (b) Scaling exponents of standard deviation for various a. tocorrelation is decreased. From these results, the relation 
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Fig. 5. (a) Statistical complexity, (b) entropy density for var- 
ious a, and (c) the relation between entropy density and sta- 
tistical complexity. 

between present data and past data is decreasing and the 
pattern in stock log return data disappears. 

In the spin model, when a is non-zero, traders ad- 
just their opinion using the difference between their an- 
ticipated prices and real market prices, and they antici- 
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pate price changes of next step with adjusted information. 
In the past, the speed of information is slower and mar- 
ket is less efficient, so adjusting behavior is more effective 
and active in the same time interval compare to present. 
Therefore, the past market corresponding to higher a has 
long range correlation and vice versa. 

If" (t) is generated randomly because its elements are 
random variables while a (x(t — 1) — x\ xp {t — 1)) provides 
regularity to ij(t) because effect of this term remains for 
a while like Markov chain. When a is 0, entropy density is 
almost 1 and complexity is because time series for a = 
are almost random. As a is increased, entropy density is 
decreased and complexity is increased because the pattern 
is generated in the time series. 

The reason why these changes occur is that speed of 
information flow is becoming fast by the development of 
infra for communication such as high speed internet, mo- 
bile communication and broadcasting systems. So market 
has become more efficient. By the efficient market hypoth- 
esis (EMH), the speed of information is so fast that agents 
can not gain profit by superiority of information. 
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[?], market efficiency [?], and the relation between shape 



analysis and agent based modelling have been studied by 



r? ?i 



lyze the financial time series. Observing probability dis- 

tribution functions (FDFs) of log return is one of the Another method is computational mechanics [?]. Corn- 
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